Systematicity and Idiosyncrasy in Iconic Gestures—A Probabilistic Model of Gesture Use
نویسندگان
چکیده
Introduction Current literature on gesture research states that the question “why different gestures take the particular physical form they do is one of the most important yet largely unaddressed questions in gesture research” [1, p. 499]. This holds especially for iconic gestures, for which information has to be mapped from some mental image into (at least partly) resembling gestural form. This transformation is neither direct nor straightforward but involves a number of issues like the composability of a suitable linguistic context, the choice of gestural representation technique (e.g., placing, drawing etc.), or the low-level choices of morphological features such as handshape or movement trajectory. Current research does not offer much concrete findings, that could inform the meaning-form mapping. We present an empirical study to elucidate some of these puzzles and a probabilistic model to simulate human gesture production.
منابع مشابه
Systematicity and Idiosyncrasy in Iconic Gesture Use: Empirical Analysis and Computational Modeling
Why an iconic gesture takes its particular form is a largely open question, given the variations one finds across both situations and speakers. We present results of an empirical study that analyzes correlations between contextual factors (referent features, discourse) and gesture features, and tests whether they are systematic (shared among speakers) or idiosyncratic (inter-individually differ...
متن کاملTo Beat or Not to Beat: Beat Gestures in Direction Giving
Research on gesture generation for embodied conversational agents (ECA’s) mostly focuses on gesture types such as pointing and iconic gestures, while ignoring another gesture type frequently used by human speakers: beat gestures. Analysis of a corpus of route descriptions showed that although annotators show very low agreement in applying a ‘beat filter’ aimed at identifying physical features o...
متن کاملInterpretation of Shape-Related Iconic Gestures in Virtual Environments
So far, approaches towards gesture recognition focused mainly on deictic and emblematic gestures. Iconics, viewed as iconic signs in the sense of Peirce, are different from deictics and emblems, for their relation to the referent is based on similarity. In the work reported here, the breakdown of the complex notion of similarity provides the key idea towards a computational model of gesture sem...
متن کاملDo young children show early sensitivity to viewpoint in iconic gestures?
Iconic gestures convey substantive information not found in speech by expressing actions or attributes associated with objects. An earlier study with adult speakers (Beattie & Shovelton, 2002) showed that adult speakers are particularly good at gleaning information from iconic gestures that use a character viewpoint (CVP; e.g., “It goes like this”+flapping arms to convey BIRD FLYING)—gestures t...
متن کاملDo iconic gestures pave the way for children's early verbs?
Children produce a deictic gesture for a particular object (point at dog) approximately three months before they produce the verbal label for that object ("dog") (Iverson & Goldin-Meadow, 2005). Gesture thus paves the way for children's early nouns. We ask here whether the same pattern-gesture preceding and predicting speech-holds for iconic gestures-that is, do gestures that depict actions pre...
متن کامل